A Neural Architecture Mimicking Humans End-to-End for Natural Language Inference
نویسندگان
چکیده
In this work we use the recent advances in representation learning to propose a neural architecture for the problem of natural language inference. Our approach is aligned to mimic how a human does the natural language inference process given two statements. The model uses variants of Long Short Term Memory (LSTM), attention mechanism and composable neural networks, to carry out the task. Each part of our model can be mapped to a clear functionality humans do for carrying out the overall task of natural language inference. The model is end-to-end differentiable enabling training by stochastic gradient descent. On Stanford Natural Language Inference(SNLI) dataset, the proposed model achieves better accuracy numbers than all published models in literature.
منابع مشابه
Coattention Answer-Pointer Networks for Question Answering
Machine comprehension (MC) and question answering (QA) are crucial tasks in natural language understanding. Training deep neural network-based QA models has become practical upon the recent release of the Stanford Question Answering Dataset (SQuAD), a significantly larger dataset of question-answer pairs created by humans on a set of Wikipedia articles [1]. In this paper, we propose an end-to-e...
متن کاملSequence to Sequence Modeling for User Simulation in Dialog Systems
User simulators are a principal offline method for training and evaluating human-computer dialog systems. In this paper, we examine simple sequence-to-sequence neural network architectures for training end-to-end, natural language to natural language, user simulators, using only raw logs of previous interactions without any additional human labelling. We compare the neural network-based simulat...
متن کاملNatural Language
We propose NEURAL ENQUIRER — a neural network architecture for answering natural language (NL) questions given a knowledge base (KB) table. Unlike previous work on end-to-end training of semantic parsers, NEURAL ENQUIRER is fully “neuralized”: it gives distributed representations of queries and KB tables, and executes queries through a series of differentiable operations. The model can be train...
متن کاملNeural enquirer: learning to query tables in natural language
We propose NEURAL ENQUIRER — a neural network architecture for answering natural language (NL) questions based on a knowledge base (KB) table. Unlike existing work on end-to-end training of semantic parsers [Pasupat and Liang, 2015; Neelakantan et al., 2015], NEURAL ENQUIRER is fully “neuralized”: it finds distributed representations of queries and KB tables, and executes queries through a seri...
متن کاملCharacter-level Intra Attention Network for Natural Language Inference
Natural language inference (NLI) is a central problem in language understanding. End-to-end artificial neural networks have reached state-of-the-art performance in NLI field recently. In this paper, we propose Characterlevel Intra Attention Network (CIAN) for the NLI task. In our model, we use the character-level convolutional network to replace the standard word embedding layer, and we use the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1611.04741 شماره
صفحات -
تاریخ انتشار 2016